Mobile terminal, electronic system and method of transmitting and receiving data using the same

ABSTRACT

Provided are a mobile terminal, an electronic system, and a method of transmitting and receiving data using the same for effectively transmitting and receiving data between the mobile terminal and external electronic devices.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.13/015,347, filed on Jan. 27, 2011, now U.S. Pat. No. 8,910,053, issuedDec. 9, 2014, which claims the benefit of earlier filing date and rightof priority to Korean Patent Application No. 10-2010-0091201, filed onSep. 16, 2010, the contents of which are all hereby incorporated byreference herein in their entirety.

BACKGROUND

1. Field

This document relates to a mobile terminal and an external electronicdevice, and more particularly, to transmission and receiving of databetween the mobile terminal and the external electronic device.

2. Related Art

Recent technological development has realized smooth data transmissionand receiving between a mobile terminal and a variety of electronicdevices.

However, conventional methods of transmitting and receiving data betweena mobile terminal and an external electronic device required a user tooperate multi-stage operations or perform complicate setting, and thusit was inconvenient for the user to use the mobile terminal

SUMMARY

An aspect of this document is to provide a mobile terminal, anelectronic system and a method of transmitting and receiving data usingthe same for effectively transmitting and receiving data between themobile terminal and external electronic devices.

In an aspect, there is provided a mobile terminal comprising a cameraadapted to capture images, and a controller configured to receive asignal to select a specific object included in an image captured via thecamera from a screen of an external electronic device, and to receive afile from the external electronic device that is related to the selectedspecific object.

In another aspect, there is provided a mobile terminal comprising acamera configured to capture images, and a controller configured toreceive a file from an external electronic device when an image of ascreen of the external electronic device is captured via the camera, thefile related to contents or an application that is executed or activatedin the external electronic device.

In another aspect, there is provided a method of receiving data in amobile terminal, the method comprising capturing an image of a screen ofan external electronic device via a camera, receiving a signal to selecta specific object included in the captured image, and receiving a filerelated to the selected specific object from the external electronicdevice.

In another aspect, there is provided a method of receiving data in amobile terminal, the method comprising capturing an image of a screen ofan external electronic device via a camera, and receiving a file fromthe external electronic device when the image of the screen of theexternal electronic device is captured, the file related to contents oran application that is executed or activated in the external electronicdevice.

In another aspect, there is provided a method of transmitting andreceiving data in an electronic system including a mobile terminal andan electronic device, the method comprising capturing, by the mobileterminal, an image of a screen of the electronic device, receiving, bythe mobile terminal, a signal for selecting a specific object includedin the captured image, transmitting, by the mobile terminal, informationrelated to the selected specific object to the electronic device, theinformation comprising at least selection information related to theselected specific object or the captured image, specifying, by theelectronic device, data related to the selected specific object by usingthe information related to the selected specific object, transmitting,by the electronic device, the specified data to the mobile terminal, andreceiving and storing, by the mobile terminal, the specified data.

In another aspect, there is provided a method of transmitting andreceiving data in an electronic system including a mobile terminal andan electronic device, the method comprising capturing, by the mobileterminal, an image of a screen of the electronic device, notifying theelectronic device, by the mobile terminal, that the image is captured,specifying, by the electronic device, data related to contents or anapplication that is executed or activated in the electronic device,transmitting, by the electronic device, the specified data to the mobileterminal, and receiving and storing, by the mobile terminal, thespecified data.

According to the mobile terminal, the electronic system and the methodof transmitting and receiving data using the same, data can be easilytransmitted and received between the mobile terminal and an externalelectronic device.

BRIEF DESCRIPTION OF THE DRAWINGS

The implementation of this document will be described in detail withreference to the following drawings in which like numerals refer to likeelements.

FIG. 1 illustrates a system environment to which this document isapplied;

FIG. 2 is a block diagram of a mobile terminal related to animplementation of this document;

FIG. 3 is a block diagram of an electronic device related to animplementation of this document;

FIG. 4 is a flowchart illustrating an implementation of a method oftransmitting and receiving data of this document;

FIGS. 5 through 13 are views for explaining the method of transmittingand receiving data shown in FIG. 4;

FIG. 14 is a flowchart illustrating another implementation of a methodof transmitting and receiving data of this document;

FIGS. 15, 16, 17 and 18 are views for explaining the method oftransmitting and receiving data shown in FIG. 14;

FIG. 19 is a flowchart illustrating another implementation of a methodof transmitting and receiving data of this document; and

FIG. 20 is a view for explaining the method of transmitting andreceiving data shown in FIG. 19.

DETAILED DESCRIPTION

Hereinafter, implementations of this document will be described indetail with reference to the attached drawings.

Hereinafter, a mobile terminal relating to this document will bedescribed below in more detail with reference to the accompanyingdrawings. In the following description, suffixes “module” and “unit” aregiven to components of the mobile terminal in consideration of onlyfacilitation of description and do not have meanings or functionsdiscriminated from each other.

The mobile terminal described in the specification can include acellular phone, a smart phone, a laptop computer, a digital broadcastingterminal, personal digital assistants (PDA), a portable multimediaplayer (PMP), a navigation system and so on.

FIG. 1 illustrates a system environment to which this document isapplied.

Referring to FIG. 1, the system environment may include a mobileterminal 100 having a display unit 151 and an electronic device 200having a display unit 210.

The mobile terminal 100 and the electronic device 200 can communicatewith each other through a wireless or wired communication method.

The communication method by which the mobile terminal 100 and theelectronic device 200 communicate with each other is not limited in thisdocument. The technical spirit of this document can be applied to allthe existing wireless communication methods and all of communicationmethods which will appear.

For example, the mobile terminal 100 and the electronic device 200 cancommunicate with each other according to communication methods such asUniversal Plug and Play (UPnP), digital living network alliance (DLNA),WiFi, local area communication, etc.

The mobile terminal 100 may include a cellular phone, a smart phone, adigital broadcasting terminal, PDA, PMP, a navigation system, a mobileInternet device (MID), etc.

The electronic device 200 may include a computer, a laptop computer,digital TV, IPTV, etc.

FIG. 2 is a block diagram of the mobile terminal 100 relating to animplementation of this document. The mobile terminal 100 can include awireless communication unit 110, an audio/video (A/V) input unit 120, auser input unit 130, a sensing unit 140, an output unit 150, a memory160, an interface 170, a controller 180, and a power supply 190. Thecomponents shown in FIG. 2 are not essential parts and the number ofcomponents included in the mobile terminal can be varied.

The components of the mobile terminal 100 will now be described.

The wireless communication unit 110 can include at least one module thatenables wireless communication between the mobile terminal 100 and awireless communication system or between the mobile terminal 100 and anetwork in which the mobile terminal 100 is located. For example, thewireless communication unit 110 can include a broadcasting receivingmodule 111, a mobile communication module 112, a wireless Internetmodule 113, a local area communication module 114 and a positioninformation module 115.

The broadcasting receiving module 111 receives broadcasting signalsand/or broadcasting related information from an external broadcastingmanagement server through a broadcasting channel.

The broadcasting channel can include a satellite channel and aterrestrial channel. The broadcasting management server can be a serverthat generates and transmits broadcasting signals and/or broadcastingrelated information or a server that receives previously createdbroadcasting signals and/or broadcasting related information andtransmits the broadcasting signals and/or broadcasting relatedinformation to a terminal. The broadcasting signals can include not onlyTV broadcasting signals, radio broadcasting signals and databroadcasting signals but also signals in the form of combination of a TVbroadcasting signal and a radio broadcasting signal.

The broadcasting related information can be information on abroadcasting channel, a broadcasting program or a broadcasting serviceprovider. The broadcasting related information can be provided eventhrough a mobile communication network. In this case, the broadcastingrelated information can be received by the mobile communication module112.

The broadcasting related information can exist in various forms. Forexample, the broadcasting related information can exist in the form ofelectronic program guide (EPG) of digital multimedia broadcasting (DMB)or in the form of electronic service guide (ESG) of digital videobroadcast-handheld (DVB-H).

The broadcasting receiving module 111 receives broadcasting signalsusing various broadcasting systems. Particularly, the broadcastingreceiving module 111 can receive digital broadcasting signals usingdigital broadcasting systems such as digital multimediabroadcasting-terrestrial (DMB-T), digital multimediabroadcasting-satellite (DMB-S), media forward link only (MediaFLO),DVB-H and integrated services digital broadcast-terrestrial (ISDB-T)systems. The broadcasting receiving module 111 can be constructed to besuited to broadcasting systems providing broadcasting signals other thanthe above-described digital broadcasting systems.

The broadcasting signals and/or broadcasting related informationreceived through the broadcasting receiving module 111 can be stored inthe memory 160.

The mobile communication module 112 transmits/receives a radio signalto/from at least one of a base station, an external terminal and aserver on a mobile communication network. The radio signal can include avoice call signal, a video telephony call signal or data in variousforms according to transmission and receiving of text/multimediamessages.

The wireless Internet module 113 means a module for wireless Internetaccess and can be included in the mobile terminal 100 or externallyattached to the mobile terminal 100. Wireless LAN (WLAN) (Wi-Fi),wireless broadband (Wibro), world interoperability for microwave access(Wimax), high speed downlink packet access (HSDPA) and so on can be usedas a wireless Internet technique.

The local area communication module 114 means a module for local areacommunication. Bluetooth, radio frequency identification (RFID),infrared data association (IrDA), ultra wideband (UWB) and ZigBee can beused as a local area communication technique.

The position information module 115 confirms or obtains the position ofthe mobile terminal. A global positioning system (GPS) module is arepresentative example of the position information module 115. Accordingto the current technology, the GPS module 115 can calculate informationon distances between one point (object) and at least three satellitesand information on the time when the distance information is measuredand apply trigonometry to the obtained distance information to obtainthree-dimensional position information on the point (object) accordingto latitude, longitude and altitude at a predetermined time.Furthermore, a method of calculating position and time information usingthree satellites and correcting the calculated position and timeinformation using another satellite is also used. In addition, the GPSmodule 115 continuously calculates the current position in real time andcalculates velocity information using the position information.

Referring to FIG. 2, the A/V input unit 120 is used to input an audiosignal or a video signal and can include a camera 121 and a microphone122. The camera 121 processes image frames of still images or movingimages obtained by an image sensor in a video telephony mode or aphotographing mode. The processed image frames can be displayed on adisplay unit 151.

The image frames processed by the camera 121 can be stored in the memory160 or transmitted to an external device through the wirelesscommunication unit 110. The mobile terminal 100 can include at least twocameras according to constitution of the terminal.

The microphone 122 receives an external audio signal in a call mode, arecording mode or a speed recognition mode and processes the receivedaudio signal into electric audio data. The audio data can be convertedinto a form that can be transmitted to a mobile communication basestation through the mobile communication module 112 and output in thecall mode. The microphone 122 can employ various noise removalalgorithms for removing noise generated when the external audio signalis received.

The user input unit 130 receives input data for controlling theoperation of the terminal from a user. The user input unit 130 caninclude a keypad, a dome switch, a touch pad (constantvoltage/capacitance), jog wheel, jog switch and so on.

The sensing unit 140 senses the current state of the mobile terminal100, such as open/close state of the mobile terminal 100, the positionof the mobile terminal 100, whether a user touches the mobile terminal100, the direction of the mobile terminal 100 andacceleration/deceleration of the mobile terminal 100 and generates asensing signal for controlling the operation of the mobile terminal 100.For example, the sensing unit 140 can sense whether a slide phone isopened or closed when the mobile terminal 100 is the slide phone.Furthermore, the sensing unit 140 can sense whether the power supply 190supplies power and whether the interface 170 is connected to an externaldevice. The sensing unit 140 can include a proximity sensor 141.

The output unit 150 generates visual, auditory or tactile output and caninclude the display unit 151, an audio output module 152, an alarm 153and a haptic module 154.

The display unit 151 displays information processed by the mobileterminal 100. For example, the display unit 151 displays user interface(UI) or graphic user interface (GUI) related to a telephone call whenthe mobile terminal is in the call mode. The display unit 151 displays acaptured or/and received image, UI or GUI when the mobile terminal 100is in the video telephony mode or the photographing mode.

The display unit 151 can include at least one of a liquid crystaldisplay, a thin film transistor liquid crystal display, an organiclight-emitting diode display, a flexible display and a three-dimensionaldisplay.

Some of these displays can be of a transparent type or a lighttransmission type. This can be referred to as a transparent display. Thetransparent display includes a transparent liquid crystal display. Therear structure of the display unit 151 can also be of the lighttransmission type. According to this structure, a user can see an objectlocated behind the body of the mobile terminal 100 through an area ofthe body of the mobile terminal 100, which is occupied by the displayunit 151.

The mobile terminal 100 can include at least two display units 151according to constitution of the terminal. For example, the mobileterminal 100 can include a plurality of displays that are arranged on asingle face at a predetermined distance or integrated. Otherwise, theplurality of displays can be arranged on different sides.

In the case where the display unit 151 and a sensor sensing touch(referred to as a touch sensor hereinafter) form a layered structure,which is referred to as a touch screen hereinafter, the display unit 151can be used as an input device in addition to an output device. Thetouch sensor can be in the form of a touch film, a touch sheet and atouch pad, for example.

The touch sensor can be constructed such that it converts a variation inpressure applied to a specific portion of the display unit 151 or avariation in capacitance generated at a specific portion of the displayunit 151 into an electric input signal. The touch sensor can beconstructed such that it can sense pressure of touch as well as theposition and area of touch.

When touch input is applied to the touch sensor, a signal correspondingto the touch input is transmitted to a touch controller. The touchcontroller processes the signal and transmits data corresponding to theprocessed signal to the controller 180. Accordingly, the controller 180can detect a touched portion of the display 151.

Referring to FIG. 2, the proximity sensor 141 can be located in aninternal region of the mobile terminal, surrounded by the touch screen,or near the touch screen. The proximity sensor senses an objectapproaching a predetermined sensing face or an object located near theproximity sensor using electromagnetic force or infrared rays withouthaving mechanical contact. The proximity sensor has lifetime longer thanthat of a contact sensor and has wide application.

The proximity sensor 141 includes a transmission type photo-electricsensor, a direct reflection type photo-electric sensor, a mirrorreflection type photo-electric sensor, a high-frequency oscillatingproximity sensor, a capacitive proximity sensor, a magnetic proximitysensor, an infrared proximity sensor, etc.

A capacitive touch screen is constructed such that proximity of apointer is detected through a variation in an electric field accordingto the proximity of the pointer. In this case, the touch screen (touchsensor) can be classified as a proximity sensor.

For convenience of explanation, an action of approaching the pointer tothe touch screen while the pointer it not being in contact with thetouch screen such that location of the pointer on the touch screen isrecognized is referred to as “proximity touch” and an action of bringthe pointer into contact with the touch screen is referred to as“contact touch” in the following description. A proximity touch point ofthe pointer on the touch screen means a point of the touch screen towhich the pointer corresponds perpendicularly to the touch screen whenthe pointer proximity-touches the touch screen.

The proximity sensor 141 senses proximity touch and a proximity touchpattern (for example, a proximity touch distance, a proximity touchdirection, a proximity touch velocity, a proximity touch time, aproximity touch position, a proximity touch moving state, etc.).Information corresponding to the sensed proximity touch action andproximity touch pattern can be displayed on the touch screen.

The audio output module 152 can output audio data received from thewireless communication unit 110 or stored in the memory 160 in a callsignal receiving mode, a telephone call mode or a recording mode, aspeech recognition mode and a broadcasting receiving mode. The audiooutput module 152 outputs audio signals related to functions (forexample, a call signal incoming tone, a message incoming tone, etc.)performed in the mobile terminal 100. The audio output module 152 caninclude a receiver, a speaker, a buzzer, etc.

The alarm 153 outputs a signal for indicating generation of an event ofthe mobile terminal 100. Examples of events generated in the mobileterminal include receiving of a call signal, receiving of a message,input of a key signal, input of touch, etc. The alarm 153 can outputsignals in forms different from video signals or audio signals, forexample, a signal for indicating generation of an event throughvibration. The video signals or the audio signals can be also outputthrough the display unit 151 or the audio output module 152.

The haptic module 154 generates various haptic effects that the user canfeel. A representative example of the haptic effects is vibration. Theintensity and pattern of vibration generated by the haptic module 154can be controlled. For example, different vibrations can be combined andoutput or sequentially output.

The haptic module 154 can generate a variety of haptic effects includingan effect of stimulus according to arrangement of pins vertically movingfor a contact skin face, an effect of stimulus according to jet force orsucking force of air through a jet hole or a sucking hole, an effect ofstimulus rubbing the skin, an effect of stimulus according to contact ofan electrode, an effect of stimulus using electrostatic force and aneffect according to reproduction of cold and warmth using an elementcapable of absorbing or radiating heat in addition to vibrations.

The haptic module 154 can not only transmit haptic effects throughdirect contact but also allow the user to feel haptic effects throughkinesthetic sense of his fingers or arms. The mobile terminal 100 caninclude at least two haptic modules 154 according to constitution of themobile terminal

The memory 160 can store a program for the operation of the controller180 and temporarily store input/output data (for example, phone book,messages, still images, moving images, etc.). The memory 160 can storedata about vibrations and sounds in various patterns, which are outputfrom when a touch input is applied to the touch screen.

The memory 160 can include at least one of a flash memory, a hard disktype memory, a multimedia card micro type memory, a card type memory(for example, SD or XD memory), a random access memory (RAM), a staticRAM (SRAM), a read-only memory (ROM), an electrically erasableprogrammable ROM (EEPROM), a programmable ROM (PROM) magnetic memory, amagnetic disk and an optical disk. The mobile terminal 100 can operatein relation to a web storage performing the storing function of thememory 160 on the Internet.

The interface 170 serves as a path to all external devices connected tothe mobile terminal 100. The interface 170 receives data from theexternal devices or power and transmits the data or power to theinternal components of the mobile terminal 100 or transmits data of themobile terminal 100 to the external devices. The interface 170 caninclude a wired/wireless headset port, an external charger port, awired/wireless data port, a memory card port, a port for connecting adevice having a user identification module, an audio I/O port, a videoI/O port, an earphone port, etc., for example.

An identification module is a chip that stores information forauthenticating the authority to use the mobile terminal 100 and caninclude a user identify module (UIM), a subscriber identify module (SIM)and a universal subscriber identify module (USIM). A device (referred toas an identification device hereinafter) including the identificationmodule can be manufactured in the form of a smart card. Accordingly, theidentification device can be connected to the mobile terminal 100through a port.

The interface 170 can serve as a path through which power from anexternal cradle is provided to the mobile terminal 100 when the mobileterminal 100 is connected to the external cradle or a path through whichvarious command signals inputted by the user through the cradle to themobile terminal 100. The various command signals or power input from thecradle can be used as a signal for confirming whether the mobileterminal 100 is correctly set in the cradle.

The controller 180 controls the overall operation of the mobileterminal. For example, the controller 180 performs control andprocessing for voice communication, data communication and videotelephony. The controller 180 can include a multimedia module 181 forplaying multimedia. The multimedia module 181 can be included in thecontroller 180 or separated from the controller 180.

The controller 180 can perform a pattern recognition process capable ofrecognizing handwriting input or picture-drawing input applied to thetouch screen as characters or images.

The power supply 190 receives external power and internal power andprovides power required for the operations of the components of themobile terminal under the control of the controller 180.

Various embodiments of this document can be implemented in a computer orsimilar device readable recording medium using software, hardware or acombination thereof, for example.

According to hardware implementation, the embodiments of this documentcan be implemented using at least one of application specific integratedcircuits (ASICs), digital signal processors (DSPs), digital signalprocessing devices (DSPDs), programmable logic devices (PLDs), fieldprogrammable gate arrays (FPGAs), processors, controllers,micro-controllers, microprocessors, electrical units for executingfunctions. In some cases, the embodiments can be implemented by thecontroller 180.

According to software implementation, embodiments such as procedures orfunctions can be implemented with a separate software module executingat least one function or operation. Software codes can be implementedaccording to a software application written in an appropriate softwarelanguage. Furthermore, the software codes can be stored in the memory160 and executed by the controller 180.

FIG. 3 is a block diagram of the electronic device 200 related to animplementation of this document.

Referring to FIG. 3, the electronic device 200 can include the displayunit 210, an audio output unit 220, a memory 230, a communication unit240, and a controller 250.

The display unit 210, the audio output unit 220, the memory 230, thecommunication unit 240, and the controller 250 can perform functionsidentical/similar to those of the corresponding components of the mobileterminal 100.

It is assumed that the display unit 151 of the mobile terminal 100 is atouch screen in this document for convenience of explanation. Asdescribed above, the touch screen 151 can perform both an informationdisplaying function and an information inputting function. However,implementations of this document are limited thereto. A touch mentionedin this document can include both a contact touch and a proximity touch.

FIG. 4 is a flowchart illustrating an implementation of a method oftransmitting and receiving data of this document and FIGS. 5 through 13are views for explaining the method of transmitting and receiving datashown in FIG. 4.

The method of transmitting and receiving data shown in FIG. 4 may beimplemented in the system environment including the mobile terminal 100and the electronic device 200, described above with reference to FIGS.1, 2 and 3. The method of transmitting and receiving data and theoperations of the mobile terminal 100 and the electronic device 200 forimplementing the method will now be explained in detail.

The mobile terminal 100 may capture an image of the screen of theexternal electronic device 200 in operation S100. FIG. 5 illustrates animplementation of the operation S100.

Referring to FIG. 5, the controller 180 of the mobile terminal 100 maydrive the camera 121 when a user operates a menu to display a camerapreview screen on the touch screen 151.

The controller 180 may provide a soft key 20 for starting apredetermined function according to this implementation through thepreview screen. The soft key 20 may have a form as shown in FIG. 5 or aslide bar shape. The soft key 20 shown in FIG. 5 is exemplary and a userinterface for starting the predetermined function according to thisimplementation is not limited to the soft key 20.

For example, the predetermined function can be started only when thesoft key 20 and a specific key included in the user input unit 130 aresimultaneously selected.

When the user touches the soft key 20, the controller 180 performs theoperation S100 to start the predetermined function.

For example, the controller 180 can capture the image currentlydisplayed on the preview screen of the touch screen 151 shown in FIG. 5as an image file when the soft key 20 is touched.

The user may display at least part of an image displayed on the displayunit 210 of the electronic device 200 on the preview screen and capturea desired image.

In FIG. 5, the display unit 210 of the electronic device 200 displaysmultiple objects. When the user displays a specific object 11 among themultiple objects on the preview screen of the touch screen 151 andtouches the soft key 20, the controller 180 can capture the image of thespecific object 11 displayed on the preview screen.

Referring to FIG. 6, the controller 180 can capture an image includingall the objects displayed on the display unit 210 of the electronicdevice 200.

The mobile terminal 100 may transmit a preparation command signal forcommanding preparation to execute an application related to thisimplementation to the electronic device 200 when the image is capturedor the soft key 20 is touched in operation S110. The electronic device200 may execute the application or prepare to execute the applicationwhen receiving the preparation command signal from the mobile terminal100 in operation S200.

The operations 110 and 200 may be omitted.

The mobile terminal 100 may receive a signal for selecting a specificobject included in the captured image from the user in operation S120.The controller 180 of the mobile terminal 100 may provide variousselection tools or user selection interfaces for selecting the specificobject.

Referring to FIG. 7, the controller 180 can receive a selection signalaccording to a touch applied to a specific object 21 included in theimage displayed on the touch screen 151 of the mobile terminal 100.

The controller 180 may recognize the object included in the displayedimage using an object recognition algorithm. Accordingly, if a pointtouched by a user's finger corresponds to the point where the specificobject 21 is displayed, the controller 180 can select the specificobject 21.

Referring to FIG. 8, the controller 180 can recognize the objectincluded in the image acquired in the operation S100 and divide theimage into multiple regions based on the recognized object. Referencenumeral 32 represents an indicating line for segmenting the image intothe multiple regions. The user can easily select a desired object withreference to the indicating line 32. Furthermore, the controller 180 mayrespectively provide check boxes for a user's choice in the regionsdivided by the indicating line 32.

Referring to FIG. 9, the controller 180 may respectively provide checkboxes 34 a, 34 b, 34 c, 34 d, 34 e, 34 f, 34 g and 34 h to the regionsdivided by the indicating line 32. The user may touch at least one ofthe check boxes 34 a, 34 b, 34 c, 34 d, 34 e, 34 f, 34 g and 34 h toselect at least one object.

The user may input a touch trace forming a looped curve corresponding toa desired object through the touch screen 151.

Referring to FIG. 10, when the user forms a looped curve 35 on the touchscreen 151 with his finger, the controller 180 can select the specificobject 21 included in the looped curve 35.

Here, the looped curve does not have to completely include the specificobject 21. When the controller 180 receives a touch trace forming alooped curve from the user, the controller 180 can select an object thatoccupies a largest portion of the looped curve.

The mobile terminal 100 may transmit information related to the selectedspecific object to the electronic device 200 in operation S130.

The information related to the selected specific object may include atleast one of an image and text. For example, the information related tothe selected specific object can include at least one of the imagecaptured in the operation S100 and the image of the specific object inthe captured image.

When the controller 180 of the mobile terminal 100 can obtainidentification information for identifying the specific object, thecontroller 180 can transmit the identification information to theelectronic device 200.

The identification information includes all information that can displayor represent the specific object. For example, the identificationinformation may be the image of the specific object and/or QR code(Quick Response Code) or a smart tag representing the image captured inthe operation S100.

If the image captured in the operation S100 includes text, such as thetitle or description of the specific object, the controller 180 mayrecognize the text and transmit the recognized text to the electronicdevice 200 as the information related to the specific object.

The electronic device 200 may receive the information related to thespecific object from the mobile terminal 100 and select a file relatedto the specific object with reference to the information related to thespecific object in operation S210. For example, if the controller 250 ofthe electronic device 200 receives an image as the information relatedto the specific object from the mobile terminal 100, the controller 250can compare the image to an image displayed on the display unit 210 orimage files stored in the memory 230 to select a file related to thespecific object. If the controller 250 of the electronic device 200receives a text as the information related to the specific object fromthe mobile terminal 100, the controller 250 can select a filecorresponding to the text as a file related to the specific object. Thefile related to the specific object, selected by the controller 250, mayinclude a text file, an image file, a video file, a memo, a web pagerelated file, etc. Furthermore, the controller 250 may select anapplication file as a file related to the specific object.

The electronic device 200 may transmit the selected file to the mobileterminal 100 in operation S220.

The mobile terminal 100 may receive the file from the electronic device200 and store the received file in operation S140.

Here, the controller 180 of the mobile terminal 100 may provide anindicator and/or related information for notifying the user of thereceiving state of the file transmitted from the electronic device 200to the user visually and/or auditorily.

The file received from the electronic device 200 may be temporarily orpermanently stored in the memory 160. When the file is temporarilystored in the memory 160, the user may select one of permanent storageand deletion.

The controller 180 may store at least one of the image captured in theoperation S100 and the file received from the electronic device 200.

When the controller 180 receives the file from the electronic device 200in the operation 220, the controller 180 may display the image 40captured in the operation S100 and the received file or an object 41representing the received file on the touch screen 151, as shown in FIG.11. In addition, the controller 180 may display a first check box 43 forselecting storage of the captured image 40 and a second check box 44 forselecting storage of the object 41. The user may select at least one ofthe captured image 40 and the object 41 using the first and second checkboxes 43 and 44 and press a soft key <Store> to store the selectedobject.

Referring to FIG. 12, when the user simultaneously multi-touches theimage 40 and the object 41, the controller 180 can store both the image40 and the object 41 in the memory 160.

Referring to FIG. 13, when the user inputs a touch signal correspondingto the object 41, the controller 180 can display a menu window 46related to the operation S140 on the touch screen 151. For example, themenu window 46 can include a storage menu 47 a corresponding to astorage command, a folder setting menu 47 b for setting a storageposition, and a name change menu 47 c for changing a file name. Thetouch signal corresponding to the object 41 may be set as a touch signalhaving a specific pattern, such as a long touch signal corresponding toa touch maintained for a predetermined time or a double touch signalcorresponding to at least two continuous touches performed within apredetermined time.

The operation described with reference to FIG. 13 can be also performedon the image 40 captured in the operation S100.

When the controller 180 stores both the image 40 and the object 41, thecontroller 180 may respectively store the image 40 and the object 41 inpredetermined different folders if storage positions are not designatedby the user.

The controller 180 may store information on a connection between theimage 40 and the object 41 or information on a relationship between theimage 40 and the object 41 when storing both the image 40 and the object41. When one of the image 40 and the object 41 is retrieved from thememory 160, the controller 180 may also retrieve the other of the image40 and the object 41 with reference to the connection information orrelationship information and display the image 40 and the object 41together. For example, when the user commands the mobile terminal 100 todisplay the image 40 on the touch screen 151, the controller 180 candisplay the object 41 as well as the image 40 on the touch screen 151.

FIG. 14 is a flowchart illustrating another implementation of a methodof transmitting and receiving data of this document and FIGS. 15, 16, 17and 18 are views for explaining the method of transmitting and receivingdata shown in FIG. 14.

The method of transmitting and receiving data shown in FIG. 14 may beimplemented in the system environment including the mobile terminal 100and the electronic device 200, described above with reference to FIGS.1, 2 and 3. The method of transmitting and receiving data and theoperations of the mobile terminal 100 and the electronic device 220 forimplementing the method will now be explained in detail.

The controller 180 of the mobile terminal 100 may display multiple iconsrespectively representing different types of contents on the touchscreen 151 in operation S300.

Referring to FIG. 15, the controller 180 can display an icon group 51representing different types of contents such as image, text, web, map,and MP3 on the touch screen 151.

The operation S300 may be performed when the mobile terminal 100 entersa camera preview mode. In FIG. 15, reference numeral 50 represents acamera preview area.

The controller 180 may receive a signal for selecting a specific iconincluded in the icon group 51 in operation S310. In FIG. 15, the userselects “WEB”. When the specific icon is selected, the controller 180may enter a mode of transmitting and receiving contents corresponding tothe specific icon. That is, the controller 180 may change the currentdisplay screen to a screen relating to transmission and receiving of thecontents corresponding to the specific icon.

The controller 180 of the mobile terminal 100 may transmit a command tothe electronic device 200 to prepare the transmission of the contentscorresponding to the selected icon in operation S320.

The electronic device 200 may execute a related application to preparethe transmission of the contents corresponding to the selected iconaccording to the command received from the mobile terminal 100 inoperation S400.

For example, the electronic device 200 can activate only the contentscorresponding to the selected icon among contents currently called,played or activated or display the contents corresponding to theselected icon on a specific region of the screen.

Furthermore, the electronic device 200 can previously specify ordetermine the contents corresponding to the selected icon.

The controller 180 of the mobile terminal 100 may capture an image ofthe screen of the electronic device 200 through the camera 121 inoperation S330. The operation S330 may correspond to the operation S100shown in FIG. 4.

The controller 180 may display the captured image on the touch screen151. In addition, the controller 180 may divide the displayed image intomultiple regions in operation S350.

Referring to FIG. 16, the controller 180 can divide the image displayedon the touch screen 151 into five regions 61 a, 61 b, 61 c, 61 d and 61e using a splitting line 60.

The controller 180 may perform the operation S350 in various manners. Inan implementation, the controller 180 transmits the image captured inthe operation S330 to the electronic device 200 in operation S340. Theelectronic device 200 receives the captured image, acquires divisioninformation for dividing the received image into multiple regions fromthe mobile terminal 100 with reference to the captured image and theimage displayed on the display unit 210, and transmits the divisioninformation to the mobile terminal 100 in operation S410. The controller180 of the mobile terminal 100 performs the operation S350 using thedivision information received from the electronic device 200.

In another implementation, the controller 180 recognizes the imagecaptured in the operation S330 as multiple objects using the objectrecognition algorithm or an image analysis algorithm and divides thecaptured image into multiple regions such that the recognized objectscan be discriminated from one another.

The controller 180 of the mobile terminal 100 may receive a signal forselecting at least one of the regions 61 a, 61 b, 61 c, 61 d and 61 e inoperation S360.

Referring to FIG. 16, the user touches a specific region 61 c among theregions 61 a, 61 b, 61 c, 61 d and 61 e by a finger to select thespecific region 61 c. When the region 61 c is selected, the controller180 can magnify the selected region 61 c and display the magnifiedregion on the touch screen 151, as shown in FIG. 17.

The controller 180 may transmit information related to the selectedregion 61 c to the electronic device 200 in operation S370. Theoperation S370 may correspond to the operation S130 shown in FIG. 4. Forexample, the information related to the selected region 61 c can includethe image corresponding to the selected region 61 c, text informationrepresenting the selected region 61 c and other identifiers.

The electronic device 200 may specify data related to the selectedregion by using the information related to the selected region, receivedfrom the mobile terminal 100, in operation S420.

Referring to FIGS. 16 and 17, the electronic device 200 can specifycontents corresponding to the specific region 61 c selected by the user,for example, a link address, image, video, audio, text, etc. included inthe specific region 61 c, as the data related to the specific region 61c. The data related to the specific region 61 c may include the specificregion 61 c or the Internet address (URL) of a web page including thespecific region 61 c.

The electronic device 200 may transmit the specified data to the mobileterminal 100 in operation S430.

The controller 180 of the mobile terminal 100 may store the specifieddata received from the electronic device 200 in operation S380. Theoperation S380 may correspond to the operation S140 shown in FIG. 4.

As shown in FIGS. 15, 16 and 17, when the user selects “WEB” from theicon group 51 in operation S310, the electronic device 200 can includethe Internet address or Internet access route in the specified data andtransmit the specified data to the mobile terminal 100.

When the mobile terminal 100 receives the data including the Internetaddress or Internet access route from the electronic device 200, themobile terminal 100 may store the contents and the Internet addressincluded in the specified data in such a manner that the contents andthe Internet address are linked to each other or independently store thecontents and the Internet address.

Referring to FIG. 18, the controller 180 can provide a user interfaceincluding text that inquires whether a specific image included in theselected specific region 61 c and an access route for accessing thespecific region 61 c or the web page including the specific region 61 cshould be stored together.

FIG. 19 is a flowchart illustrating another implementation of a methodfor transmitting and receiving data of this document and FIG. 20 is aview for explaining the method of transmitting and receiving data shownin FIG. 19.

The method of transmitting and receiving data shown in FIG. 19 may beimplemented in the system environment including the mobile terminal 100and the electronic device 200, described above with reference to FIGS.1, 2 and 3. The method of transmitting and receiving data and theoperations of the mobile terminal 100 and the electronic device 200 forimplementing the method will now be explained in detail.

The controller 180 of the mobile terminal 100 may capture an image ofthe screen of the external electronic device 200 through the camera 121in operation S500. The operation S500 may correspond to the operationS100 shown in FIG. 4.

Referring to FIG. 20, the controller 180 can capture an image 80including objects 70 and 71 displayed on the screen of the electronicdevice 200 through the camera 121 and display the image 80 on the touchscreen 151.

The controller 180 may notify the electronic device 200 that the image80 is captured in operation S510.

The electronic device 200 may specify data related to contents or anapplication currently executed or activated therein when the electricdevice 200 is notified that the mobile terminal 100 captures the image80 in operation S520.

In FIG. 20, the first object 70 displayed on the display unit 210 of theelectronic device 200 is activated and the second object 71 displayed onthe display unit 210 is temporarily inactivated due to the activation ofthe first object 70. Accordingly, the electronic device 200 can specifydata related to the first object 70 corresponding to an activated objectas data to be transmitted to the mobile terminal 100.

The electronic device 200 may transmit the data specified in theoperation S520 to the mobile terminal 100 in operation S530.

The mobile terminal 100 may store the specified data received from theelectronic device 200 in operation S540. The operation S540 maycorrespond to the operation S140 shown in FIG. 4.

The above-described method of transmitting and receiving data may bewritten as computer programs and may be implemented in digitalmicroprocessors that execute the programs using a computer readablerecording medium. The method of transmitting and receiving data may beexecuted through software. The software may include code segments thatperform required tasks. Programs or code segments may also be stored ina processor readable medium or may be transmitted according to acomputer data signal combined with a carrier through a transmissionmedium or communication network.

The computer readable recording medium may be any data storage devicethat can store data that can be thereafter read by a computer system.Examples of the computer readable recording medium may include read-onlymemory (ROM), random-access memory (RAM), CD-ROMs, DVD±ROM, DVD-RAM,magnetic tapes, floppy disks, optical data storage devices. The computerreadable recording medium may also be distributed over network coupledcomputer systems so that the computer readable code is stored andexecuted in a distribution fashion.

Other implementations are within the scope of the following claims.

What is claimed is:
 1. A mobile terminal comprising: a wireless communication unit configured to transmit and receive information; a touch screen configured to display information; a memory configured to store information; a camera configured to capture images; and a controller configured to: control the camera to capture an image of a screen of an external electronic device, wherein the screen of the external electronic device comprises a web page; control the touch screen to display the captured image comprising an image corresponding to the web page; request data related to the captured image from the external electronic device; receive data including an Internet address corresponding to the web page from the external electronic device; and cause the memory to store the captured image to be associated with the Internet address.
 2. The mobile terminal of claim 1, wherein the controller is further configured to: divide the displayed captured image into multiple regions; receive a signal for selecting a specific region of the multiple regions; request data related to the selected specific region from the external electronic device.
 3. The mobile terminal of claim 2, wherein the controller is further configured to: transmit the captured image to the external electronic device; receive division information for dividing the captured image from the external electronic device; and divide the captured image into the multiple regions using the received division information.
 4. The mobile terminal of claim 2, wherein the controller is further configured to: recognize multiple objects in the captured image; and divide the captured image into multiple regions such that the recognized objects are distinguished from one another.
 5. The mobile terminal of claim 2, wherein the controller is further configured to magnify the selected region and display the magnified region on the touch screen when the specific region is selected.
 6. The mobile terminal of claim 2, wherein the multiple regions are divided using a splitting line.
 7. The mobile terminal of claim 1, wherein the controller is further configured to: control the touch screen to display a soft key during an activation mode of the camera; and capture an image of a screen of an external electronic device and request data related to the captured image from the external electronic device in response to selection of the soft key.
 8. The mobile terminal of claim 1, wherein the controller is further configured to cause the memory store the captured image and the received data independently. 